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Abstract — The purpose of the research is to suggest and the 
describe a new standard for productivity of the research activity. 
The Hirsh index based on scree method has become popular 
inperforming scientists' work productivity. This index is also 
applied to scientific groups (organisations). However, h-index 
and other scientometric indexes based on citations can be 
artificially increased with the help of scam models. Thus, there is 
a necessity to develop a new standard of assessment of a research 
activity efficiency that will be difficult (hard) to “improve”. The 
authors suggest geographic latitude index of the relevance of 
citations. Despite the fact that suggested index as h-index based 
on citations, its big importance indicates that scientific union 
accepts the results of academic staff activity. Moreover, the 
given index could be a standard for identifying prospective 
(productive) scientific workers. To achieve the objectives and 
tasks the following correlated methods have been used: the 
analysis of problem citation, the analysis of scientific references 
and best practice of research activity management in scientific 
institutions, universities (benchmarking), cognitive, 
structure-functional and mathematic modeling, the method of 
graph theory, sets and relations; automated systematic cognitive 
analysis; method of qualimetry (theory of latent variables); 
method of mathematic statistics, method of analytic geometry. 
The research was carried out on the basis of high schools of 
Krasnodar Region. It was also used methodological base of the 
research: system approach, metasystem approach, probabilistic 
statistical method, sociological and qualimetric approaches. 

Index Terms — scientists team, research activity, results, 
references, geographic latitude, necessity, diagnosis. 

I. Introduction 

The diagnosis of productivity of research activity of 
scientists and teams is one of the most actual but at the same 
time complicated scientometric tasks [1-23]. The Hirsh index 
and different scientometric activities based on citations have 
instantly become popular thanks to its objectiveness and 
humanistic potential. Unlike such activity as an average 
number for publication, h-index based on scree method 
(widely-used method of mathematical statistics) does not 
“forbid” a scientific worker to publish new scientific works 
(i.e. publications without citations that do not reduce complex 
scientometric index). However, research activity diagnosis 
based on the citation analysis have number of risks. One of 
such risks is connected with a desire and opportunity to 
increase artificially scientometric activity as well as the 
h-index [2,8-10,12] known as Goodhart's law that states: 
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’’When a measure becomes a target, it ceases to be a good 
measure”. Applied to scientometric, “Hirshmania” has 
become one of social disasters of new century [2, 8-10,12], 

Thus, scientometric as the branch of science of science as 
well as management practice of research activity in scientific 
and educational institutions are in dire need in objective 
measures of productivity research activity that cannot be 
artificially improved. The problem of study is to find out the 
objective criterias of productivity of scientists not influenced 
by artificial improvement. The research objective is to 
present and explain new criteria for productive diagnosis of 
research activity. The target of the current study is 
scientific (research) activity of scientists. The subject of the 
research is the informative value and latitude index of 
citation relevance (citation ratio) in scientific research results 
(scientific publications). To achieve the objective the 
following tasks are important to set up: 

1. To develop calculation model for a new scientometric 
index-latitude index of citation relevance (citation ratio) in 
scientific research results (scientific publications). 

2. To determine connection between latitude index of 
citation relevancein scientific research results and financial 
support of scientists' research projects on the base of actual 
data. 

3. To single out gradation of numerical values of a the new 
scientometric index - latitude index of citation relevance 
(citation ratio) in scientific research results (scientific 
publications). 

The solution of the above-mentioned problem, the purpose 
achievement and tasks solution are actual with an increase in 
research activity in modern world and also to support W. von 
Humboldt's ideas of Universities as the core of science. 

n. The analysis of the developed problem 

There are two correlated ways of struggling against social 
disasters connected with absolutization of “selected” indexes. 
The first one is polyvalent diagnosis and monitoring of 
scientists' research activity. The second way is to create 
adequate monitoring indexes not influenced by (or hardly 
influenced) artificial “improvement”. The third way is the 
optimal combination of the 1 st and the 2 nd ones. 

The authors of the article and their colleagues have made an 
attempt to implement the 2 nd way. Thus, for example, 
Romanov D.A. has offered citation index of specific 
publication of scientist: 

Z = n, + f) 0,75' + Z 0,5' > 

where n , - number of external citations for a publication, 

n 2 - number of citations on co-author's publication (on 
scientometric basis) 

n 3 - number of self-citations of a co-author. 
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Above-mentioned index [12,17] has been compiled on the 
basis of author's approach [15] that states complex 
monitoring indexes are calculated on the basis of theory of 
limits aimed at loss of meaning of nonterminating increase of 
input monitoring information that can be artificially raised 
(both self-citation and co-author citation). Modified h- index 
is equal to Z. If Z scientist's publications have citation index 
at least more than Z (citation index can be fractional). 

Romanova M.L. has suggested in her scientific work [13] 
that scientific publication quality 

^ = (i+c) 2 -(i+z)-s-(i+ j d), 

where C-impact factor of publication, 
s - coefficient of publication status, 

D-coefficient depended on extra information of 
publication. 

The modified Hirsh index is equal to K. If K scientist 
publications have scientific quality at least more than K. 

As we can see two above mentioned indexes are rather 
difficult to “improve” with scam models. 

Undoubtedly, assessing recognition results of research 
activity (recognition is in citation publication of a researcher) 
Herfindahl index assessment (currently used in scientific 
journals) can be used to assess inequality citation of a scientist 
on the part of social environment. Herfindahl index is 
“harmful” index, i.e. the increase of its numerical value can 
deteriorate the situation. Evidently, if a scientific worker is 
cited by a rather limited number of people there will be high 
h-index. However, the authors of this article state that low 
h- index does not mean high recognition of a scientist's 
publication (research activity results) as low h-index can be 
matched with low number of citations on scientists' works. 

Complex scientometric index - h-index has some 
disadvantages. Taking its importance and relevance into 
account the authors underline its limitation in scientific 
worker's publication assessment. Undoubtedly, the 
possibility in its artificial “improvement” is laid in the evils of 
society. However, h-index as the index based on citations 
cannot fully show real results of a research activity. This 
inference is supported by facts. What bibliometric indexes 
(ex. H-index) do Maxwell, Faradey, Lomonosov, Mendeleev, 
Archimedes (lack of the article volume doesn't allow to give 
the full list) have? Can you even imagine a textbook on 
physics without D. Maxwell or A.S. Popov's names, on 
chemistry- D. Mendeleev, M. Lomonosov or H. Cavendish, 
on mathematics-R. Decart or N. 

Lobachevskiy'sachievements? 

Thus, it is important to create and describe a new objective 
criteria of scientists' research activity (including teachers of 
universities). 

III. Research organization and methodology 
Complementary methods of research, for example, the 
problematic situation analysis, analysis of scientific literature 
and advanced experience of managing research activities in 
scientific organizations - such as universities 
(benchmarking), cognitive, structurally-functional and 
mathematical modeling, graphs, relations and sets theory 
methods, automatized systematically-cognitive analysis, 
qualimetry methods (latent variable theory), mathematical 
statistics and analytical geometry methods were used in 
achieving our goal and problem solution. We should pay 
special attention to mathematical methods role in our 


research. Scientist’s or team’s research activity result 
importance is taken as integral index (latent variable), for 
which we can pick up particular criteria (indicator variables). 
Set, relation and graph theory methods let us create cognitive 
models of creative (research) team’s activity, their influence 
on scientific community (scientific megaenvironment) in 
general. Analytical geometry methods, which were used to 
calculate the area of convex polygon (convex polygon 
represents the subset of cities, where the authors of citing 
publications live and work) turned out to be the most useful. 

The research was based on Krasnodar Region’s 
universities. With the help of qualimetry methods (latent 
variables theory), authors were able to pick out a new criteria 
of research activity rating - geographic demand (recognition) 
index. Thanks to Russian Science Citation Index, (website 
elibrary.ru) result data of primary research activity of 
Krasnodar Region’s professors (n=420) was received. 
Financial support data (in form of scientific foundation 
grants) was received from university’s scientific research 
managements (Kuban State Technology University), as well 
as open domain publications. Automatized 
systematic-cognitive analysis has let us find out validity and 
differentiating ability of author’s research activity 
productivity index of scientists. Informational entropy is 
calculated by formula 

where p is a probability (relative frequency) of a scientist to 
appear in one or another cluster (clusterization 
criteria is an index, suggested by author), 

C is an amount of clusters (there are 10 pointed out). 

Our research methodological basis is systematic approach 
(takes research activity as a complex systematic process and 
integral part of university’s functioning), metasystematic 
approach (takes citation publication complex of scientist as a 
system, which includes relatively independent components), 
probability-statistical (takes recognition of scientist’s 
research activity as a stochastic process), sociological (takes 
science as sociocultural phenomenon and social institute and 
university as social system, which is the core of science, 
according to Humboldt’s concept) and qualimetrical 
approach (announces the necessity of multi-criteria diagnosis 
of scientist’s research activity productivity). 


IV. Research result 

From author’s point of view, we can take geographic result 
demand as an objective and resilient to ‘perfection’ criteria of 
research activity productivity. This means, the wider the 
geographical distribution of links (citations) of some scientist, 
the more surely we can speak of his recognition (demand) by 
science community. For example, if works of one scientist is 
cited in ten cities, separated with hundreds of kilometers, and 
another is cited only in one city, then undoubtedly, the first 
one’s work is more recognized than the second one’s (even if 
both have the same publication rate, citing amount and 
h-index). Obviously, geographic latitude of links (citations) 
should be measured not by science magazine assortment, in 
which the works (citation sources) are published, but by 
author’s workplaces. Because it’s possible that one author 
may cite another from different magazines, but we can’t talk 
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of geographic latitude in that case (even more, false index 
increase may happen). 

Let q be a set of analyzed scientist publications and w is a 
set of citations to these works, w is a subset of citations, which 
are not self-citations, then an amount of publications Q=P(q), 
amount of citations (not self-citing) W=P(w), where P is 
cardinality (further in the article we’ll only mention links, 
which are not self-citing) Also obviously, that w = uJ^fwj, 
where Wj is a link set (citing publications, but not 
self-citing), according to a number j of analyzed scientist 
work. Then result demand index of analyzed scientist by 
geographic latitude is X= S * q , where r|=P(N). Here, P is 
cardinality, N is a set of localities, where the authors of citing 
publications live (work). S is an area of the convex polygon, 
surrounding the localities of N set (we should have such 
polygon, that localities of N set would be on polygon’s edge 
or inside of it, but not outside). If we have two localities, then 
we take distance between them as a polygon’s area. If we only 
have one locality, than the polygon’s area is equal to locality 
area (For example, the area of Krasnodar is more than one 
hundred square kilometers). 

Obviously, N = Uj^rij , where n j is a locality set, which 
consists of places where the authors of citing publication 
number j work and live. For example, one author of citing 
publication lives in Kaliningrad, another lives in Volgograd, 
and the third one lives in Krasnoyarsk. From author’s point of 
view, X index can objectively represent the scientist’s 
publication recognition by scientific community. On one 
hand, if the area of imagined polygon takes millions of square 
kilometers, then it’s unlikely, that scientist had a “deal” with 
all of the citing publications authors. On other hand, this index 
makes artificial “citing deal” of scientists, who five in the 
same locality, useless. 

With all that, while objectively representing the results of 
scientist’s research activity, this index doesn’t take 
productiveness in account. For example, we can achieve the 
same value of X by writing 10 works, as well as 20. By 
simplified scheme, the productivity index (or scientific 

community influence index) can be measured as n = — , 

where z is minimal amount of scientist’s publications (not the 
citing publications), to provide X index. We can calculate z 
with this algorithm. 

Step 1 . Take z equal to Q. 

Step 2. Reduce z by 1 . 

Step 3. Check if X has reduced and go back to step 2 if it 
hasn’t. 

For example, some scientist’s index X (publications 
demand index by geographic latitude) is 5*10 7 , all in all he 
has published 120 works, but only 40 of them provide the X 
value. Then the scientist’s productiveness index is 
H = 5*10 7 /40 =1.25 *10 6 . 

More labor-intensive (in sense calculations) is another 
scientist’s productiveness rating algorithm. We analyze all 
possible combinations of scientist’s publications (the amount 
of these combinations is huge) and we calculate the [lj value 
every j numbered transaction (more specific, publication 
combination) (obviously, not only z, but X would vary), then 


The presented indexes are also fit for rating the demand 
(recognition) of research activity result of research teams 
(including educational research teams of universities). 
However, instead of one scientist’s publication set we analyze 
research team members publication set. Research team 
publication set is q' = UjLiqj , where M is amount of research 
team members, e/ ; is publication set of j team member, U is 
set union symbol. 

For rating the informational content and validity of 
suggested scientometric index of demand (citation) of 
research activity results by geographic latitude, the authors 
researched the correlation between its numeric value and 
funding of scientific researches (research projects). From 
author’s point of view, scientist’s or team’s research project 
funding (for example, scientific foundation grant, 
crowdfunding, etc.) represents the appropriate level of their 
research activity. Undoubtedly, funding system (especially 
the granting one) has drawbacks (as well as scientific prize 
system), but it allows to preserve the traditions of research 
(scientific) activities. 

By analyzing the indexes, which represent the recognition 
of research activity results of Krasnodar Region’s scientists 
(faculty of universities), we were able to differentiate 
scientists by index of demand (citation) of research activity 
results by geographic latitude X (chart l).The research was 
done according to April 2016 data. By taking together relative 
frequencies of scientists (probability of scientist being in one 
or another cluster) we have an entropy equal to 2,176; The 
most effective scientist (by authors criteria) is 1,73* 10 5 times 
more effective than the least effective one. 

Chart 1 . Demand index of research activity results by 


geograi 

phic latitude of Krasnodar Region scientists. 

Cluster 

JVs 

Demand index 

Number 

of 

scientists 

Their 

percentage 

1 . 

More than 10 s 

9 

2.142857 

2. 

From 10 7 to 10 s 

19 

4.52381 

3. 

From5*10 6 to 10 7 

27 

6.428571 

4. 

From 106to5*10 6 

32 

7.619048 

5. 

From 5*10 5 to 10 6 

37 

8.809524 

6. 

From 10 5 to 5*10 5 

40 

9.52381 

7. 

From5*10 4 to 10 5 

51 

12.14286 

8. 

From 10 4 to 5*10 4 

67 

15.95238 

9. 

From 5*10 3 to 10 4 

79 

18.80952 

10. 

Less than 5*10 3 

59 

14.04762 


All in all, there were 23 financed (by one or another 
foundation) research projects, where 127 scientists of 
Krasnodar Region were taking part, each of them had 
different demand of research activities index, that’s why a 
geographic latitude rating for a team is needed. Actual data 
analysis showed that from 23 teams, 5 had the highest demand 
of research activities result index level (more than 10 s ), 16 
had very high level (from 107 to 10 8 ) and 2 had high level 
(from 5*10 6 to 10 7 ). 

By analyzing the results of this research, we can see that a 
high value of demand index of research activity results by 
geographic latitude is a necessary, but not sufficient condition 
of research project (scientific research) funding. In other 
words, if we take scientific community as a megaexpert and 
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funding committee as a macroexpert, we should note that only 
those results, that are recognized both by megaexpert and 
macroexpert may be considered high quality. 

Geographic latitude method allows us also to determine 
recognition of specific scientist’s publication by scientific 
community: ^ = 10“ 6 *Z*S pub *Tj pub , where Z is 

publication’s citing index (according to Romanov’s method), 
S pub is area of imagined convex polygon, which connects 
localities of where the citing publications (link source of 
analyzed publication of the current scientist) authors live and 
work. rj pub is an amount of localities (they can also be inside 
of imagined polygon). Correction factor is introduced to 
normalize recognition index. Then value L of productivity 
index is equal to x, if no less than % publications of analyzed 
scientist have recognition index not less than % each. 

We should also note that, magazines and scientific 
community do not always share the same opinion. It is 
possible that an article may be published in a prestigious 
magazine with high ratings (impact factor), but it doesn’t get 
(according to citing) much recognition by scientific 
community. 

It is also possible that the article is published in a magazine 
with not so high impact factor, but it gets recognized by 
scientific community, gets cited from different country 
regions (if we mean national scientometric basis of a large 
country) or countries (if we mean international scientometric 
basis, such as Web of Science, Scopus, Agris, DOAJ, 
EBSCO, etc.). 

According to authors' opinion L possible gradations 
quantity are the following: less than 5 is the lowest level, from 
5 to 9-low level, from 10 to 19- medium, from 15 to 19 is the 
right level (above average), from 20 to 24 is high level, from 
25 to 29-very high level, above 29 is the highest level. 

Within the given article the authors consider an appropriate 
to give practical recommendations that can increase the 
effectiveness of research activity. First of all, it is important to 
build information portal for keeping publication data of high 
quality (publications on pdf-format as a sample!) as well as 
the most productive scientific workers. The importance of 
making such portals is to provide targets for professional 
growth and sample results of research activity of scientific 
workers. But more important thing is the availability of 
information resources that can allow scientific-pedagogic 
officers to use research activity results of their colleagues 
(among with their own results!) in education content. 


V. Conclusion 

The geographical latitude index of the relevance of 
citations is a standard that allows to single out high-effective 
scientific workers. This index is difficult to improve 
artificially. 

VI. Summary 

1 . It is necessary to introduce a new scientometric index for 
scientific productivity of researchers to avoid its artificial 
improvement. 

2. The geographical latitude index of the relevance of 
citation suggested by the authors is a standard of research 
productivity assessment of a scientific worker that considers 
new recognition aspects of its results. A metasystem approach 


is the most important methodological basis for assessing this 
index as the authors of cited publications five and work in 
areas which represent a metasystem. A system with 
independent components, mathematical framework - the 
theory of sets and analytical geometry as well. 

3. There is clear connection between the author’s 
recognition of the research and the funding of the scientific 
projects that proves the validity (authenticity) and the 
informative character of the author’s index. 

The high level of geographical latitude index and relevance 
of the research results is a reflection of the proper level of 
scientists research work and groups and this, in turn, is a main 
factor for funding research projects, grants and etc. 

4. The assessment of the scientists research work efficiency 
must be versatile taking into account different aspects of how 
these research work result are recognized by the Scientific 
Community. 

The Hirsh index and the latitude index of the relevance of 
research work results are interrelated. They are used to 
monitor the scientists’ research projects. 
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